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Figures 

Figure 1 



Figure 2 
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Figure 3 




Figure 4 
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Figure 5 
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Figure 9 

Input information to a buffer 




(Optional) Perform preprocessing on 
pattern Pi 



^ 905 

Is Pi complex? ^^-^ 



No 








Assign phase to Pi 


to make it a complex array 



906 
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Figure 10 

Transport information from buffer to cortex or cortex to buffer 



1001 



Propagate Pi from Buffer 102 
to Cortex 103 




? s — 



1002 



1003 




(Optional) Store the 
propagated pattern 



Figure 11 

^102a 




Figure 12 




03 
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Figure 13 

Associate two or more patterns 



1301 



Load a propagated 
pattern Pi into memory, 
if necessary 




1302 



Pattern array Pi' on Cortex 103 



Yes 


^—1304 


Associate the selected patterns 
together via an invertible 
mathematical operation 








, ^—1306 





1305 



New association 
(P'u Pj, ..., Pi>on Cortex 103 



(Optional) Store the 
new association(s) 
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Figure 15 

Superpose two or more associations 



-1501 



Load an association into / 
memory, if necessary ^/ 




Yes 



1504 



Form a linear combination of the 
appropriate associations 



-1502 



m m association 
<r\ m , F 5 ^, .... P\,m) on Cortex 103 



1505 



1506 



LZ 



Updated Cortex 103 



(Optional) Store the 
updated Cortex 103 
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Figure 16 



De-associate a pattern from a stored cortex 

-1601 




Yes 



1604 



Perform de-association using the 
inverse of the association function 



1605 



1606 



(Optional) Store the 
de-associated wave 

d 



De-associated wave d on Cortex 
103 



Figure 17 
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D = <C| Ri,n> 

Figure 18 

Export buffer information 



1801 



Retrieved wave D evaluated on Buffer 
104b 



^1802 




Convert values of retrieved wave 
D to original form 




/ ^-1803 




^1804 


Converted form of D 


/ (Optional) Store the / 







converted wave as 
data file 
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Figure 19 

Generate an internal identification pattern (IIP) 



Select a unique, machine-readable 
identification code 



1903 



Generate a unique, machine- 
readable internal identification 
pattern (IIP) 



-1905 



(Optional) Store the 
identification code 
and IIP 



-1901 



1902 



Identification code Lj 



1904 



Internal identifier pattern (IIP) I 



Figure 20 
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Figure 21 

Decode a retrieved internal identification pattern (IIP) 



Read in a retrieved IIP, J) 



-2101 
-2103 



-2102 



Analyze the retrieved IIP 

i 



Retrieved IIP, Jj 



Extract redundant candidate 
identification codes from the IIP 



-2104 



-2106 



2105 



Calculate confidence estimate 




2108 




Re-analyze the IIP to yield an 
alternative set of identification codes 



-2111 



Report failure to identify 
a pattern associated 
with the retrieved IIP, Jj 

^—2113 



2114 



Alternative candidate identification codes 
{U...,L} 
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Figure 22 

Leam 



-2201 




Load an input pattern P l>n into 
memory to be learned 
according to Figure 9 



Z 



Yes 



-2204 



Propagate patterns Pj, n> Pj, nj ..., Pi,n to 
Cortex 103 according to 
Figure 10 



-2206 



Perform association of Pi,n, Pj,n Pi,n 

according to Figure 13 



-2208 



(Optional) Superpose the new 
association with previously stored 
associations according to 
Figure 15 



2210 




2211 



(Optional) Store the 
updated Cortex 103 



-2202 



Input pattern array Pj, n on 
Buffer 102 



-2205 



Propagated, input patterns Pi >n , Pj,n 
Pi,n on Cortex 103 



-2207 



New association 
<Pii, Pj,n, ...,Pi,n> on Cortex 103 



-2209 



Updated Cortex 103 



Figure 23 
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Recognize 



-2301 



Load a prompting 
pattern Ri, n into memory, 
if necessary, to make a 
retrieval, according to 
Figure 9 



2303 



Transport Ri, n to Cortex 103 
according to Figure 10 



-2305 



Perform de-association of 
Cortex 103 using Rj,n according to 
Figure 16 



-2307 



Propagate complex conjugate of 
de-associated wave D to the 
appropriate buffer(s) 



-2309 



Convert retrieved wave D to 
original field form according to 
Figure 18 . 



-2311 



(Optional) Store the 
retrieval 



-2302 



Prompting pattern array Ri, n on Buffer 
, 102 



-2304 



Propagated; prompting pattern array 
, Ri n on Cortex 103 



-2306 



De-associated wave ti on Cortex 103 



-2308 



Retrieved wave 0 evaluated on one or 
; > ■ , • , more buffers •. 



-2310 



Retrieved field D 
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Figure 24 

Learn for autonomous identification 



-2401 



Load an input pattern Pi, n into memory 
to be learned, according to 
Figure 9 




2403 



No 



2404 



Generate an IIP for Pi, n , Pj t n,...,Pi,n 
according to Figure 19 



-2406 



Gather registration information 



I 



-2408 



Transport patterns Pi, n , Pj,n,...,Pi,n and 
IIP In to Cortex 103 according to 
Figure 10 



1 

Perform as 

Pi,n, Pj,n, Pl.n 

to Fig 


sociation of 
and l n according 
ure13 




r s 


(Optional) Superpose the new 
association with previously stored 
associations according to 
Figure 15 



-2410 



-2412 




2415 



(Optional) Store the 
updated Cortex 103 



2402 




2411 
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Figure 25 

Identify and respond autonomously 




Load a pattern Rj, n into 
memory to be identified, 
according to 
Figure 9 




2501 



-2502 



Prompting pattern array Rj, n on Buffer 
102 



1 


f 




Recognize Rj, n according to 
Figure 23 




r f 




Decode IIP Jn according to 
Figure 21 



-2503 



-2504 



Retrieved IIP, J n 



-2505 



-2506 



Reported identification code U and 
confidence estimate E n 
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Figure 26 A 

Adaptively improve identification performance through experience 



-2601 



Identify pattern Ri, n according to Figure 25 



-2603 



Yes 



Monitor correctness of system's identification 



-2606 



Incorrect ID, IIP l p 
returned (p^m) 



-2602 



Reported identification 
code U and confidence 
estimate E n 




-2611 



False rejection 
or 

correct ID but 
confidence estimate 
too low 
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Figure 26B 

Adaptively improve identification performance through experience 
(continued) 



-2606 



Incorrect ID, IIP l p 
returned (p*m) 



False positive 



-2607 



Adjust cortex to weaken association 

0fRi, n With P| >m 



2608 



Re-introduce pattern Ri >n to 
be identified 




20/74 

Figure 26C 

Adaptively improve identification performance through experience 
(continued) 



False negative 



o 



-2611 



False rejection 
or 

correct ID but 
confidence estimate 
too low 




Incorporate 



Replace 



-2613 



Broaden the association of 
Pi, m with pattern Pj, q 



1 


^—2614 


Replace the original pattern 
P lim withPi, q 



2615 





Re-introduce pattern Ri >n to 


< 


► 


be identified 
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Figure 35 figure 36 
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Figure 43 
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Figure 45 



Figure 46 
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Figure 47 




Figure 49A 



Figure 49B 
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Figure 50A Figure SOB 
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Figure 53A 
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Figure 53B 
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Figure 54 A 




Lr-5400 



Figure 54B 
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Figure 55A Figure 55B 
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Figure 56 Figure 57 
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Figure 60A Figure 60B 
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Figure 63A Figure 63B 
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Figure 66A Fi&ire 66B 





Figure 68A Figure 68B 
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Figure 69A Figure 69B 




Figure 71 



Figure 72 
7100 H 



Lr-7200 
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Figure 73 




Figure 75A 



Figure 75B 
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Figure 76A F'gwe 76B 
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Figure 79 



Figure 80 



IIP Reconstruction (Steve K.) 




IIP Reconstruction (Steve K. 1) 
4.1% obscured 
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Figure 81 



2.50E*O2 



> Reconstruction (Steve K. 7) 
33.4% obscured 




7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 



Position 



Figure 82 

ilP Reconstruction as a Function of Degree of Obscurity 

4.5% -, " 




0.0% -I -i — ■ 1 ' 1 ' ' 

0% 5% 10% 15% 20% 25% 30% 35% 40% 

Percentage of Image Obscured 
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Figure 83A Figure 83 B 
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Figure 86A Figure 86B 
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Figure 89A Figure 89B 




Figure 92A 



Figure 92B 
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Figure 94A 
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Figure 96A Figure 96B 
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Figure 99A Figure 99B 
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Figure 100A Figure 100B 
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Figure 102A Figure 102B 
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Figure 105 Figure 106 




Figure 109 



Figure 110 

10504 P^S^^Bwi^^^^SHkr- 11 000 
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Figure 111 Figure 112 
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Figure 119A 



Figure 119B 
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Figure 120A F'g»»* 1 2 ° B 
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Figure 125 
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Figure 131 Figure 132 




Figure 133 Figure 134 




Figure 135 Figure 136 
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Figure 137 Figure 138 




Figure 139 Figure 140 




Figure 141 



Figure 142 
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Figure 143 Figure 144 

fcr- 14300 
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Figure 145 




Figure 147 
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Figure 152A 

Flowchart for software embodiment: Overall Control 



( Start ) 



15202 



15201 



Initialize: Read disk file with parameters & transportation matrix 
into RAM 



15206 



Defined, new, empty Cortex 
103 



15205 



Permanent 
storage 



15203 



A-tensor, X, buffer 
and cortex 
dimensions, etc. 



Define 
C=0 


No 


(empty Cortex 


< < 


103} 





15202 




15208 



60/74 



Figure 152B 

Flowchart for software embodiment: Overall Control (continued) 
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Figure 153 

Flowchart for software embodiment: Create IIP 



c 



Subroutine CreatellP 



15301 



Get alphanumeric 
label from keyboard 



15303 



Convert label to 8-bit binary string 
IB(i) of label's ASCII code 



-15304 



Call DrawtlP 



15305 



15306 



Create new data file linked to ASCII 
code for the IIP 



IIP for the selected 
ASCII code 



15307 



Get input to file 
(photos, criminal 
record, etc.) from 
keyboard 




15308 



NewdataJile 
opened 



15309 



IIP and related 
files 



15202 



15311 



Store files and 
UP on disk 




Return y 
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Figure 154A 

Flowchart for software embodiment: Learn 



C 



Subroutine Learn 



Input file 
specified from 
keyboard 




15401 



-15404 



Call Import 



-15407 



Get IIP 
alphanumeric label 
from keyboard 



15408 



Convert IIP label to 8-bit binary string 
IB(i) of label's ASCII code 



-15410 



Call Import 



CD 



15202 



Permanent 
storage 



15403 



Input file retrieved 
from disk 



15405 



Input file defined on 
Buffer 102 



15406 



Input file defined as 
Ci(ij) for all points 
(on Cortex 103 



15202 




IIP file retrieved from 
disk 



15411 



IIP defined on IIP 
Buffer 303 



15412 



$IH£ defined as C$$K 
for all points (ij) on r 
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Figure 154B 

Flowchart for software embodiment: Learn (continued) 



1 


, / ^-15413 


Associate files: 




C3(ij)=Ci(ij)*C2(i,j) for all points (ij) 




on Cortex 103 






^-15415 



15414 



New association C3 
defined on Cortex 
103 



Get fraction (a) of the new 
association C3 to add to the 

total cortex file Con 
Cortex 103 from keyboard 



1 


, ^15416 




Add association to total cortex array: 
C(i j)=C(ij)+a*C 3 (i j) for all points 
(ij) on Cortex 103 




1 


^15417 



15418 



Store updated total 
cortex file C 



Contents of updated 
cortex C defined on 
Cortex 103 



15202 



^ Return ^ 



Permanent 
storage 
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Figure 155A 

Flowchart for software embodiment: Recognize 



c 



Subroutine Recognize 



Input file to be 
identified specified 
from keyboard 




15501 



15504 



Call Import 



15507 



Divide input array ^into full cortex 
array C for all points (ij) on 
Cortex 103: 

r f -*;c # /|*,|' 



15509 



Call Retrieve 



15511 



Take magnitude of complex IIP array 
15510 



15202 



Permanent 
storage 

15503 



Input file retrieved 
from disk 



15505 



Input file defined on 
Buffer 102 



15506 



Input file defined as 
for all points 
(ij) on Cortex 103 



15508 



Retrieved file 
defined as y(ij) for 
all points (ij) on 
Cortex 103 



-15510 



IIP array defined on 
IIP Buffer 303 



-15512 



Magnitude of IIP 
defined on IIP Buffer 
303 



Figure 155B 
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Flowchart for software embodiment: Recognize (continued) 




1 


f , 1551' 


3 




Call ReadllP 






1 


15514 

r 1 



ZGet file(s) from disk using 
returned file name 
llPCode' 
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Figure 156A 

Flowchart for software embodiment: Draw IIP 



Subroutine DrawllP ^) 



15601 



Define IIP filename: convert 8-bit 
binary code IB(i) to a character string 
and append ".raw" 



15602 



Create an IIP file with that name 



15604 



Initialize IIP array: 
BIIP(ixjy)=Oforall points (ixjy) on IIP 
Buffer 303 



-15603 



IIP file for the . 
selected ASCII code , 
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Figure 156B 

Flowchart for software embodiment: Draw IIP (continued) 



1 




ix=-25, iy=25 




r ^-1 



15605 



15606 



15611 




15613 
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Figure 157 



Flowchart for software embodiment: Import 



c 



Subroutine Import 



3 



15202 



15701 



Read specified disk file into 
buffer array B 0 (ij) for all points 
(ij) on Buffer 102 



Permanent 
storage 



-15702 



15703 



Apply phase to create complex-valued 
array: e.g., 
B(ij)=dcmplx(Bo(ijrcos(P*Bo(ij)) J 
Bo(ij) t sin(p*B 0 (ij))) 
for all points (ij) on Buffer 102, 
where p is an arbitrary phase 
multiplier 




Input file retrieved 
from disk 



15704 



Complex array B(i j) 
' defined on Buffer 
102 



Loop over all 
source points 
(k,l) on Buffer 
102 




15705 



1 



15706 



Loop over all 
destination 

points (ij) on 
Cortex 103 




15707 



Calculate cortex array: 
C(ij)=C(ij) + A(ij,k,irB(k,l) 
where is A(i,j,k,l) is the transportation 
tensor defined by Eq. 23 



-15708 



(* Return J 



Returned complex, 
array C(ij) defined 
on Cortex 103 
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Figure 158 

Flowchart for software embodiment: Retrieve 



c 



Subroutine Retrieve 



1 




Begin with array of complex numbers 
defined on Cortex 103 




, ^—15803 



15801 



-15802 



Complex array C(i,j) 
defined on Cortex 
103 




Loop over all 
source points 
(ij) on Cortex 
103 



15804 



Loop over all 
destination 

points (k,l) on 
Buffer 102 




15805 



Calculate buffer array: 
B(k,l)=B(k > l) + A(k,l > i l jrC(ij) 
where is A(ij,k,l) is the transportation 
tensor defined by Eq.23 



o 



15806 



Q Return J 



Returned complex 
array B(ij) defined 
on Buffer 102 
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Figure 159 A 

Flowchart for software embodiment: Read IIP 



c 



Subroutine ReadllP 



15901 



Take magnitudes in IIP Buffer 301 at 
the locations defined by the DrawllP 
subroutine, according to Figure 157 



15903 



Find largest value (IIPMax(i)) and 
smallest value (IIPMin(i)) in each bar, 
where i (1<i<4) indicates the i m bar 



15904 



Set initial breakpoint BP 

4 

BP=1/8£ [ IIPMax(i) + IIPMin(i) ] 



15905 



Set iteration index n=0 



15906 



n = n + 1 



15907 



Initialize confidence value v, which 
represents uncertainty in the 
identification, to 0 



15902 



0 



(^(D??lEtt!EB(IIr^EZ®S)b 
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Figure 159B 

Flowchart for software embodiment: Read IIP (continued) 




Loop over IIP bits 
Doj=1to8 




15908 




Loop over IIP bars 
Do i=1 to 4 




15909 



15913 



Tentative IIP bit values 
IIPBit(i,j), where i (1<i<4) 
indicates the i* bar and j 
(1<j<8) indicates the f bit 



IIPRaw(i,j) < BP? 


No 






r s — 


IIPBit(ij) = 1 


i 


r 



15910 



15911 



Yes 



IIPBit(i,j) = 0 



15912 



o 
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Figure 1S9C 

Flowchart for software embodiment: Read IIP (continued) 




No 
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Figure 159D 

Flowchart for software embodiment: Read IIP (continued) 

^-15922 




Tentative IIP code UPCodefl) 
based on current BP, where j 
(1<i<8) indicates the i ft bit 



15924 



Report failure 
to make an 
identification 



15926 



Report IIP code 
[IIPCode(j)]and 
confidence score 
(v) 




No 


r 15927 




Call FindNewBreakPoint 









c 



Return 
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Figure 160 

Flowchart for software embodiment: Find New Breakpoint 



Subroutine FindNewBreakPoint 



16001 



Discard all tentative IIP bit values 
IIPBit(i,j) for which bit j has a 2:2 vote 



16002 



Rank all remaining bit values by size and 
note whether each is designated a 0 or 
1 (based on 3:1 or 4:0 vote) 



-16003 



Tentative IIP bit values 
IIPBit(i,j), ranked by size 



16304 



Arrays of O's 
(HPZeroes(k)) andl's 
(HPOnes(k)), ranked by 
size 



16005 



Normal distribution: 
Alt 1s> all O's? 



Yes 



^ 16006 

New BP=1/2 [ Min( HPOnes(k) ) 
+ Max( HPZeroes(k)) ) 



No 



16007 



Slight overlap: 
Largest 0> smallest 1? 



16008 



Yes 



NewBP=1/2(Min(IIP0nes(k)) 
+ Max(IIPZeroes(k))). Discard those two 
values in IIPBit(i,j) 



Wo 




Discard abnormal value 



